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Abstract 

In future networks, an operator may employ a wide range of access points using diverse radio 
access technologies (RATs) over multiple licensed and unlicensed frequency bands. This paper studies 
centralized user association and spectrum allocation across many access points in such a heterogeneous 
network (HetNet). Such centralized control is on a relatively slow timescale to allow information 
exchange and joint optimization over multiple cells. This is in contrast and complementary to fast 
timescale distributed scheduling. A queueing model is introduced to capture the lower spectral efficiency, 
reliability, and additional delays of data transmission over the unlicensed bands due to contention and/or 
listen-before-talk requirements. Two optimization-based spectrum allocation schemes are proposed along 
with efficient algorithms for computing the allocations. The proposed solutions are fully aware of 
traffic loads, network topology, as well as external interference levels in the unlicensed bands. Packet- 
level simulation results show that the proposed schemes significantly outperform orthogonal and full- 
frequency-reuse allocations under all traffic conditions. 

Index Terms 

Long term evolution (LTE), LTE in unlicensed spectrum (LTE-U), multiple radio access technolo¬ 
gies, spectrum allocation, user association. 
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I. Introduction 

The wireless industry has set an ambitious goal to increase the area capacity (in bits per 
second per square meter) by three orders of magnitude in the next five to ten years. In addition 
to densely deploying small cells and improving the spectral efficiency [2], another avenue is 
to exploit all available spectrum, which is a relatively scarce resource [3j]. Future generation 
cellular networks are likely to involve multiple radio access technologies (RATs) over multiple 
frequency bands (including millimeter wave). Such RATs include Long Term Evolution (LTE), 
WiFi, and LTE in unlicensed spectrum (LTE-U). The prime bands today are licensed frequency 
bands under 3 GHz and over 500 MHz of unlicensed spectrum in the 2.4 GHz and 5 GHz 
frequency bands. 

Current 4G cellular networks generally use regular frequency reuse patterns, including full 
frequency reuse and fractional frequency reuse. In the former scheme, every cell uses all available 
frequency bands, whereas the latter scheme is similar, except that cells use orthogonal frequency 
bands at the cell edge to reduce mutual interference. However, such simple methods are not 
as effective in emerging heterogeneous networks (HetNets), whose topologies are often highly 
irregular, and whose small cells have widely varying traffic conditions. 

There have been many studies on spectrum allocation in cellular networks (see, e.g., |4j- 


[ 161). Most authors formulate the allocation problem as that of deciding, for each slice of the 
spectrum, which access points (APs) and/or links should use it. In addition, user association 


was considered in 121, [13]. In general, NP-hard nonconvex integer programming problems are 
formulated, which typically have many local optima. Furthermore, the figures of merit used in 
most work are physical layer performance measures such as sum rate and outage probability. 
These traffic-independent metrics may not reflect a user’s relevant quality of service (QoS) in 
HetNets with large traffic variations in overlapping cells with complicated interference conditions. 

To address the preceding issues, an alternative optimization-based framework was developed 


in [17] and [18] for allocating downlink spectrum resources in a HetNet. This framework allows 
arbitrary user association and flexible spectrum allocation, driven entirely by users’ traffic loads. 
This framework is well matched to emerging centralized remote processing architectures such 
as cloud radio access network (C-RAN) and cell-free massive multiple-input multiple-output 
systems [19]. In contrast to most existing work [j6]-[10], which considers resource allocation on 
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the timescale of a frame, here the timescale of resource adaptation is conceived to be once every 
few seconds or minutes. This timescale is, on the one hand, fast enough for tracking aggregate 
traffic variations and large-scale fading, and, on the other hand, slow enough to allow information 
exchange and joint optimization of many APs with a large number of user equipments (UEs). 
Another advantage is that the spectrum resources can be assumed to be homogeneous on this 
timescale, namely, every segment in the same band has about the same spectral efficiency when 
averaged over many frames. The approach in [17] has been generalized to incorporate energy- 


efficient allocation via cell activation [18] as well as the effect of opportunistic scheduling on a 
fast timescale 

In this work we generalize the framework of [17] and |[T8| to the scenario in which there 
are multiple RATs over multiple frequency bands. Resource allocation over multiple RATs has 


been studied in [22]—[24]. In [22], the authors presented a scheme for balancing licensed and 
unlicensed traffic in the case of a single femto user and single WiFi user. In [231, [24], joint 
licensed and unlicensed resource allocation algorithms were proposed for licensed-assisted access 
systems for throughput and energy efficiency maximization, respectively. However, the distinct 
characteristics of the unlicensed bands were not modeled in those papers. In our work, different 
queueing models are proposed to distinguish the characteristics of licensed and unlicensed bands. 
The multiple-band allocation problem is formulated as a bi-convex optimization problem. A 
conservative allocation scheme is first proposed following the approach of [17] and |T8j. This 
is followed by a utilization-dependent allocation scheme which incorporates the utilizations of 
the APs into the formulation to more accurately account for dynamic inter-cell interference. An 
iterative algorithm is designed to solve the allocation problem with manageable computational 
complexity for small systems. In each step, we solve a convex problem with a unique optimal 
solution. 

Another feature of this work is that the packet length is allowed to have a general probability 
distribution. In prior work [JT7], [T8j, p0| and [21], the packet length is assumed to be expo¬ 
nentially distributed to yield a simple analytic form in the objective representing the QoS. We 
show that the proposed formulation and algorithm apply to general packet length distributions 
and hence a broader class of traffic conditions. 

To evaluate the performance, packet-level simulations are carried out. It is shown that both the 
conservative allocation scheme and the utilization-based allocation scheme significantly reduce 
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the average packet delay in the heavy traffic regime compared to orthogonal allocation and full- 
frequency-reuse allocation. The large performance gain is observed mainly because the proposed 
schemes are traffic-aware and also exploit the particular characteristics of each RAT. In addition, 
the utilization-dependent allocation scheme attains the best performance over all traffic conditions 
due to its accurate modeling of the dynamic interference among APs. 

One practical application of this work is the emerging C-RAN which allows many remote radio 
function units connect to a centralized network controller. The total overhead for the network 
controller to perform the proposed resource allocation scheme includes collecting the spectral 
efficiencies of all links and users’ traffic information. Since the timescale of resource adaptation 
is considered to be once every a few seconds or minutes, the overhead is quite small. For 
example, the rate for sending 30,000 parameters (16 bits each) every minute is only 8 kilobits 
per second (kbps). 

The remainder of this paper is organized as follows. The system model is introduced in Section 
II. An optimization problem using the conservative allocation is formulated in Section III. A 
utilization-dependent allocation scheme is presented in Section IV. The extension to general 
packet length distributions is given in Section V. Simulation results are presented in Section 
VI and concluding remarks are given in Section VII. All technical proofs are relegated to the 
appendices. 


II. System Model 


In this section, we introduce models for user traffic, spectrum allocation, and link throughput. 


The models extend those in [18] to accommodate multiple RATs. A new queueing model is then 
introduced for traffic over unlicensed bands. 


A. Spectrum Allocation 

We consider the downlink of a heterogeneous network consisting of n APs and many UEs. 
Without loss of generality, suppose each AP can use all m different RATs, with each RAT 
on a separate frequency band. Since UEs located near each other often have similar channel 
conditions, these UEs can be treated as a group on the slow timescale. This is a generalization 
of the extreme case where each UE group contains only one single UE. Moreover, it suffices to 
carry out the slow timescale allocation to the UE groups rather than individual UEs. 
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Fig. 1. Illustration of all patterns of a 3-AP network. The allocations to 2 users are revealed under pattern {1,3}. 


Denote the set of all APs by AT = {1, n}, the set of all user groups by /C = {1, k}, 
and the set of RATs by Ad = (1, RAT l employs its separate homogeneous spectrum 

of bandwidth w^ l \ We allow arbitrary association so that each AP can simultaneously serve 
any subset of UE groups and each UE can be simultaneously served by any subset of APs. 
Furthermore, we allow flexible resource allocation in that each AP-UE link can use an arbitrary 
number of RATs, where each RAT uses an arbitrary (possibly discontinuous) subset of the 
available spectrum. Despite the enormous number of possibilities, we will show that the actual 
AP-UE association and spectrum allocation is extremely sparse. 

The key to total spectrum agility is the notion of pattern [17], [18]. In general, a pattern 
simply refers to a subset of transmitters. A time-frequency resource is said to be reserved for 
pattern A if the resource is to be shared by transmitters in A.Q In the downlink, a pattern A is 
a subset of J\f, and all APs in A have access to the time-frequency resources associated with 
pattern A. Assuming known transmit power spectral densities (PSDs), the pattern of a resource 
determines the signal-to-interference-plus-noise ratio (SINR) and hence the spectral efficiencies 
of all links over the resource. The allocation problem can then be formulated as how to divide 
the spectrum of each RAT among all 2 n — 1 nonempty patterns. To illustrate the concept of 
pattern with an example as shown in Fig. |Tj suppose there are three APs operating over one 
frequency band. The spectrum can be divided into 2 3 — 1 = 7 segments, where one segment is 
used by AP 1 exclusively (the pattern is {1}), a second is used by AP 2 exclusively (the pattern 
is {2}), a third is used by AP 3 exclusively (the pattern is {3}) and the remaining four segments 


'The notion of pattern finds its root in the concept of independent set defined in the special case where the network is 
described by a conflict graph, and where nodes/links in the independent set share the same resources |25|. 
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include three shared by the two APs (the patterns are {1,2}, {2,3}, and {1,3}, respectively) as 
well as one segment shared by all three APs (the pattern is {1, 2, 3}). If the transmit pattern of 
a certain spectrum resource is {1,2}, i.e., both APs transmit, then the spectral efficiencies of all 
links are determined as discussed below. 

A network controller collects traffic load and channel/interference information from all the 
APs. Because the time period of slow timescale allocation is much longer than the channel 
coherence time, the channel conditions are modeled using path loss and the statistics of fading. 
Given the average channel and traffic conditions, the task of the central controller is to determine 
which spectrum segments to allocate to each AP, and subsequently, which sub-segments to 
allocate to specific UEs associated with that AP. To be precise, we need to solve the following 
three subproblems: 

1) Decide which RAT or RATs should be used to serve each UE group. 

2) Allocate the bandwidth across all 2 n patterns for each RAT. This is denoted by a 2 n x m- 
tuple: y = (y A ' 1 )acAT,igM> where y Ayl e [0,1] is the fraction of spectrum assigned to RAT 
l shared by APs in set A. Clearly, 

^2 y M = 1, VI e M (1) 

AcAT 

and any efficient allocation would not use the empty pattern, so that y 0 ' 1 = 0, for every 

l e M. 

3) For every pattern A C JV, for every AP j 6 i, divide the bandwidth y AJ to the UE 
groups. Denote the bandwidth allocated to the link i —» j over pattern A under RAT l as 
x tij- As shown in Fig. 1, yf 1 ’ 3 ! (colored yellow) is further divided by AP 1 into two parts 
to serve UE group 1 and UE group 2, respectively, while AP 3 divides the same shared 
spectrum differently. Then we have: 

Y xf^j < y A \ Vi e A, A c Af,l e M. (2) 

j&K, 

The user association is indirectly determined by the amount of spectrum resources assigned by 
each AP to each group. Specifically, UE j is assigned to AP i over RAT l if and only if > 0 
for some pattern A. 
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B. From Spectrum to Transmission Rates 


An important measure of user QoS is the average packet delay in the system. The delay is 
determined by the packet arrival statistics and the service rates. The instantaneous service rate 
of a UE group’s queue in turn depends on the spectral efficiencies along with the bandwidths 
allocated to that specific UE group. For simplicity, it is assumed that when AP i transmits 
over RAT l, it employs all patterns available to it and applies a flat PSD p'p over the allocated 
spectrum. At any frequency designated for RAT l, the instantaneous spectral efficiency achievable 
by the link from AP i to UE j depends on the set of active APs A C J\f using that frequency. 


Let this (spectral) efficiency be denoted by Clearly, ■ = 0 if i ^ A. Moreover, the 


A,l 






spectral efficiency decreases as more APs become active, i.e., sfij > x°A if i G A C B. On 
the slow timescale, the spectral efficiencies are either known a priori or can be measured and 
sent to the central controller. For later convenience, we normalize the spectral efficiency over 
RAT l using factor L/w ® (bits/second/Hz) so that the unit of sf^ >J is packets/second. 

For concreteness in obtaining numerical results, we use Shannon’s formula to arrive at the 
expression for link efficiencies: 


B,l 


A,l _ 

i~>j 


q/COk/Oi^ £ A) 


log 2 1 + 



packets/s, 


(3) 


where L is the average packet length in bitsQ a (l> e (0,1] is the discount factor for RAT l, 
l(i G A) — 1 if i G A and lit <E A) = 0 otherwise, and /' 4 ; , / is the total noise plus interference 
PSD from other APs in A to UE j, which depends on their transmit PSDs and path loss. The 
discount factor of a licensed band is typically closer to 1 than that of an unlicensed band due 
to external interference from other operators in the unlicensed band. The discount factor is not 
crucial and is merely included for flexibility of the model. The average effect of small-scale 
fading can be included by considering the ergodic capacity in lieu of <(3]), which does not change 
the main developments of this paper. 

Over a resource reserved for pattern A, only the subset of APs in A with data to transmit will 
be using the resource at any given time. In general, the instantaneous service rate depends on 


2 Packet lengths are assumed to be i.i.d. with exponential distribution; later we will show that the proposed methods can be 
applied to general packet length distributions. 




the set of transmitting APs and the rate adaptation scheme. Two service rate models are adopted 
as described in the following. 


Under the conservative allocation introduced in [17], if some of RAT Vs spectrum resources 
reserved for pattern A are allocated to link i —>• j, then AP i transmits UE j’s packets at spectral 
efficiency using RAT l over pattern A. This rate is achievable even if all APs in A have 
data to transmit (hence the name conservative). This is equivalent to assuming that other APs’ 
traffic is always backlogged. The rate contributed by spectrum reserved for pattern A under RAT 
l is the product of the spectral efficiency and the bandwidth: The total service rate for 

the queue of UE j over RAT / is the sum rate of all APs and patterns, expressed as: 


<■? = £ £ sf4j x tij packets/s. (4) 

AcJ\T i&Af 

The advantage of the conservative allocation is that there is no need for the scheduler (or 
whichever unit that performs rate adaptation) to know the state of the other APs included in 
the pattern. However, the conservative rate (|4]) is a lower bound on the actual rate because the 
interference is overestimated. 

To adapt the allocation to the actual interference pattern, we introduce a new model in 
this work, referred to as the utilization-dependent model. Under this model, the service rate 
contributed by the spectrum reserved for pattern A depends on the subset of transmitting APs 
in A. Specifically, the service rate for UE group j over RAT l when the set of active interfering 
APs is X is expressed as: 



11 s llJ' x H packets/s. 

AcAf i£Af 


(5) 


C. Queueing Model 

Without loss of generality, we restrict the subsequent investigation to the scenario with two 
RATs, where one RAT is over the licensed band (conceived as LTE) and the other is over the 
unlicensed band (conceived as LTE-U). This can be easily generalized to more than two RATs. 

The traffic to UE group j is modeled as an independent Poisson point process with rate A j 
packets per second. The packet lengths are independent random variables whose average is L 
bits. Packets intended for each UE group are transmitted according to the first-in-first-out (FIFO) 
discipline. The buffer in each queue is assumed to be unlimited for simplicity. The traffic load of 
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Fig. 2. Illustration of queueing model of LTE-U. 


UE group j is further divided into two streams served by the two RATs, respectively. This may 
be implemented by dividing the group of UEs for association with different RATs, so that each 
UE is only served by one RAT. The resulting packet arrival rates of two streams are denoted as 
and X^ 2 \ respectively, which are variables to be optimized subject to the constraint: 

+ Af > Xj. (6) 


For each RAT, the corresponding k UE groups form a system of k interactive queues where the 
instantaneous service rate of each queue may depend on which other queues are empty. 

The physical and/or medium access control layers of LTE-U are designed to facilitate co¬ 
existence with other RATs in unlicensed bands, such as WiFiJ^J In [27], a listen-before-talk 
scheme was proposed in which carrier sensing is embedded in a deterministic portion of a 


LTE subframe. In [28], the authors proposed the use of LTE uplink power control to improve 
LTE/WiFi coexistence. References [29j and [ f30| propose to enable LTE/WiFi coexistence by 
muting LTE transmission on certain subframes following a pre-determined pattern. 

In this paper, we assume that LTE-U has a listen-before-talk feature, which is likely to be a 


dominant mode in emerging LTE-U standards [26]. In this mode, an AP operating LTE-U with 
data to send first performs carrier sensing before its transmission. We use queues with vacation 


and nonexhaustive service [311 to model such a mechanism. The queueing scheme is depicted 
in Fig. [2} Specifically, the server of queue j will take a single vacation after completing the 
service of each packet. The vacation duration Vj (in seconds) is a random variable following a 
certain distribution. The mean and variance of the vacation time depend on the level of local 


’Challenges of such coexistence are discussed in 
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interference^] such as interference from WiFi users. The higher the interference level, the more 
time a queue has to wait before being served. 


III. Queueing Delays and A Conservative Allocation Scheme 


In this section, we adopt the conservative service rate model ([4]) to develop a scheme for 
allocating licensed and unlicensed spectrum. For each RAT, the corresponding k UE groups 
form k independent M/M /1 queues, because the service rate of each queue is independent of 
the states of other queues under the model Q. Let RAT 1 represent LTE and RAT 2 represent 
LTE-U. 


Under LTE, the average packet delay (in seconds/packet) of UE group j is given by the 
average delay for the M/M/1 queue: 




*?’) 


(7) 


where (x) + = x if x > 0 and (tr) + = 0 if x < 0. If r ^ \ the queueing delay is infinite, 

i.e., the queue becomes unstable. It is important to note that the right hand side of (7) is convex 
in the pair (r^, A^) on R 2 . 

Under LTE-U, the k UE groups form k independent M/M/1 queues with single vacation. We 
have: 

Proposition 1 : The average packet delay (in seconds/packet) of a queue with Poisson arrival 
of rate A and a single server of rate r with single vacation V whose expected squared duration 
is v = E[V 2 ] is given by: 


t = 


2 + r\v 


2(r — A) + 

For fixed u, the function defined by (8) is convex in the pair (r, A) on R 2 . 
The proof of Proposition 1 is given in Appendix A. 


( 8 ) 


4 Although coexistence issues in the unlicensed band are very important over fast timescales, over slow timescales, effective 
interference levels and associated packet delays suffice to characterize how LTE-U interacts with other devices in the unlicensed 
band. 
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The joint user association and conservative spectrum allocation problem is formulated as PI: 


minimize 

r,x,y,\,t 

1 £(W + AfV’) 
h J jeK 


(PI a) 

subject to 

t (l) = 1 

JG/C 

(Plb) 


f (2) 2 + rfAfV, 

' ^( r f- Af) + ' 

jelC 

(Pic) 


T-EEA'A', 

AcAf ieN 

j e 1C, le {1,2} 

(Pld) 


A* 1 ’ + Af > A,, 

jelC 

(Pie) 


v it ■ E AA 

jeic 

l e {1,2},* e J\f,A c N 

(Plf) 


E A = i, 

AcAf 

le{ 1,2} 

(Pig) 


44j > o, 

j e 1C, l e {l, 2}, i e N, A c U. 

(Plh) 


The objective (P1 a) is the average packet delay of all queues over the entire network. (Plb) is 
the average packet delay of each UE group served by LTE as derived in (7). (Pic) is the average 
packet delay of each UE group served by LTE-U as derived in (8). (Pld) is the service rate of each 
divided UE group using the conservative model as given in (4). (Pie) is the total traffic constraint 
for each user type (6). (Plf) guarantees the consistency of the spectrum allocation as given in 
(2). (Pig) constrains the total bandwidth of each RAT to be one unit. (Plh) precludes negative 
bandwidth. The variables in PI are r,x,y,X,t which are the vector forms of { 1)2 }, 

{ x tij)jeK,,ieAT,AcM,ie{i,2}, (y A ’ l )AcAf,ie{i,2}, (4)jcic,ie{ 1 , 2 }, (t^)jeK,ie{i,2}, respectively. 

PI is a bi-convex optimization problem because when variable A (resp. x) is fixed, all 
constraints are linear and the objective is a linear combination of convex functions in x (resp. 
A). Therefore, PI can be solved by alternating optimization over A and x. Since the sequence 
of objective values obtained at each iteration is lower-bounded and non-increasing, the objective 
converges although it may not be a global minimum. As shown in Section VI, the alternating 
method achieves good performance. 

Theorem 1\ The (global) minimum average delay can be achieved by a sparse allocation, 
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where the spectrum of each RAT is divided into at most k segments. That is, there exists an 
optimal solution that satisfies 

\{A \ y A ’ 1 > 0,A <Z J\f}\ < k, VI e M (9) 

where | • | denotes the cardinality of a set. The same applies to the delay achieved by the 
alternating optimization method. 

Theorem 1 is proved in Appendix B. The theorem guarantees that although the number of 
all possible patterns grows exponentially with the number of APs in the network, using a small 
number of patterns achieves the optimal performance. 

Theorem 2: Assume the channel gains are jointly continuous random variables. The (global) 
minimum average delay can be achieved with at most n — 1 user groups served by multiple APs 
on each RAT. That is, there exists an optimal solution that satisfies 

{j | x? 2 2 _lj > 0, for some i x ,i 2 G JV and Ai, A 2 C JV} <n — 1, VI G M . (10) 

The same applies to the delay achieved by the alternating optimization method. 

Theorem 2 is proved in Appendix C. The theorem guarantees that although we allow a UE 
group to be served by multiple APs, most UE groups will be associated with only one AP in 
the optimal solution. 

IV. A Utilization-Dependent Allocation Scheme 

In this section, we adopt the utilization-dependent service rate model (5). Unlike in the 
conservative scheme, we now let each AP adapt its transmission rates to the instantaneous set 
of active interfering APs. Thus the service rate is in general higher than the conservative rate. 

In a stable interactive queueing system, each AP transmits (over each RAT) for a fraction of 
the time, referred to as the utilization. Denote the utilization of AP i over RAT l as pp G [0,1]. 
The analysis of interactive queueing system is difficult. As an approximation, we assume that 
different APs transmit independently over each RAT. The probability of an active interfering AP 
set X over RAT l is then: 



When UE group j is served, its instantaneous service rate is one of 2 n possible values depending 
on the set of active APs. Thus we use a certain “average” of 2 n independent M/M/1 queues to 
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approximate the queueing behavior of UE group j with interactive queues. Such an approximation 
is reasonable under the premise that for any AP, the influence of other APs is adequately 
represented by their steady state probability distribution. Under each RAT, the average delay 
of UE group j is calculated as the expected delay over 2 n possible rates: 


t (1) = V 

3 fXA 


P 


1,1 


ICJV Vj A j ) 
p I,2 (2 + 


A = E 


1,2 


1CAT 2 ( r j -'j 


a< 2 V 


(12a) 


(12b) 


The utilization of UE group j is calculated as its expected utilization over all possible sets of 

interfering APs. Specifically, when the active set of APs is X, the fraction of time that group j 

A (0 

is served is At, the average utility is obtained as: 


«J° = 


\(0 

XCAT r j 


(13) 


Since AP i may serve multiple UE groups over each RAT, the utilization of AP i depends on 
the utilization of its associated UE groups. We approximate the utilization of AP i over RAT l 
as its average utilization over the spectrum used. Specifically, the average amount of spectrum 
used by AP % to serve its UEs is ^ a- ' 1 x tif Hence AP z’s utilization is approximated as 


' J / J l—¥j* 

jeK A:ieA 




E v M h? 


j 


(14) 


A:ieA 


A-.ieA jeK 


where y AJ I s th e tota l bandwidth used by AP i over RAT l. 

A:ieA 

With the above approximation, the joint user association and utilization-dependent spectrum 



14 


allocation problem is formulated as P2: 


minimize 

r,x,y,\,t,cr,p,p 


subject to 


hr 3 & 


*?' = 


j.(2) _ 


£ i.y 


p 


,i.i 


xcAT (r^-A^ 


+ ’ 


E 


p x,2(2 _)_ 


xcM 2lrf 2 -\ 


( 2 ) 


+ ’ 


I,l 

T j = 


Y Y, sy - x 


Anl,l A,l 
X i—*j i 


AcAf i£Af 


A' 1 ’ + Af> > A,, 


y A, ‘ > E 


x: 


.tot,/ 


jex: 


^ r 4 ’* = 1, 

AcAf 

> o, 


/■' = 


(0 

Pi = 


If’ 

v iex 

1 


(0 


n<i -a 


(ih 


E I/* 

zt:i£zt 


vt 


lEE 

zt:iezt jefc 


(0 xl,/ 
a j x i^j’ 


(P2a) 

j e/C (P2b) 


je/C (P2c) 

IC^j6/C,l6{l,2} (P2d) 

J e/C (P2e) 
l e {1,2},* e AC, A C A/” (P2f) 

l e {1,2} (P2g) 

je/C,le{l,2},«e^,^cAC (P2h) 
l G {1, 2}, I C A/" (P2i) 

l G {1,2},* G A/” (P2j) 


A (0 

l e {1)2},j e /C. (P2k) 

XcA/ - r j 

The objective (P2a) is also average packet delay of all queues of the entire network. (P2d) is 
the service rate of each divided UE group using utilization model as in (5). The variables in P2 are 

r, x, y, X, t, <r, p, p which are of the vector forms of (rf l ) XC Af,jeK,ie{i, 2 }, (xtij)jeK,ieAf,AcAf,ie{i, 2 }, 
(y A ’ l )AcAf,ie{i, 2 }, (^)jeic,ie{ 1 , 2 }, ( 4 ^)fe/c,ie{i, 2 }, {(X^)jeK,ie{i, 2 }, 

(p!°) ieAT,ie{i,2}’ an d {p X ' 1 )t<zN,i&{i, 2 }, respectively. P2 would be equivalent to PI if we let pAU = 

1, p IJ = 0 for every I ^ AC, and a (y = 1 for every l and j. (This is a feasible suboptimal 
solution.) Unlike PI, P2 is not bi-convex because new variables and nonlinear constraints are 
introduced. However, when fixing the variables rr. p and p. it becomes bi-convex. Therefore, we 
divide P2 into two subproblems and solve them alternately to update all the variables. 
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Algorithm 1 Update cr, p and p 

Step 1. Initialization: set initial utilization of UE groups cr(0); 

Step 2. Update: a j (m) g- XI P 1 ' 1 ^ — 1 )tj, 

zca/" V ' 



A:ieA 


E E 

A:ieAjelC 


l G {1, 2}, j G /C 
l G {1, 2}, z G A/" 


p i,i {m) 4r~ ("n f n (i - p?m)1 , 

Viez / \i'£x / 


l G {1,2},I C A/" 

SX J \i'£T J 

m 4— m + 1; 

Step 3. if || cr(m) — cr {m — 1) ||> e, where e is a small number, go back to Step 2; otherwise 
stop and obtain 

a G- af\m), p ^ G- p[ * l \m), p 1,1 G- p x ' l (m), l G {1,2}, j G /C, z G A/”,X C A/". 


Algorithm 2 Iterative algorithm for solving P2 

Initialization: a: G- 0; a?' G- 1; G- 1, Vj G 1C,! G {l,2};p-^ G- l,Vi G A/",/ G 
{1, 2};^ g- 1, G- 0, VX C N, X ± M. 
while ||a? — x'\\ > e do 

1. x' G- X\ 

2. Update r, x, y , A, t by solving P3; 

3. Update cr.p,p by using Algorithm 1. 

end while 


Given cr, p and p , we update r, .x\ y. A, t by solving subproblem P3: 

1 


minimize 


r,x,y,\,t X] X 


-B« + « 

(P3a) 

1 j&K. 


\(0 

l G {1,2};j G /C 

V 

(P3b) 


je/c 


XcAr 

(P2b) - (P2h). 


(P3b) constraints the utilization of UE groups. The structure of subproblem P3 is similar to that 
of PI. It can be solve by alternating optimization over A and x. 

Given r, x, y. A, t, we update cr, p and p. There are 2(2 n + n + /;:) variables and equations. 


To solve them with low complexity, Algorithm 1 updates cr, p and p iteratively as in [|20), [21j. 
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Here m denotes the iteration. Convergence of the algorithm can be established similarly as in 
120], [21 ]. In addition, the solution obtained by Algorithm 1 is feasible for (P2i)-(P2k). 

After solving two subproblems alternately, P2 can be solved using Algorithm 2. Each step in 
Algorithm 2 is an easier problem. Convergence of Algorithm 2 can also be similarly established 
as in J20J, 0. Therefore, P2 can be solved iteratively with low complexity. 


V. Extension 


So far, the packet lengths are assumed to be i.i.d with exponential distribution, which results in 
exponentially distributed service time for each packet. In this section, we show that the proposed 
schemes and algorithms are also applicable to general packet length distributions as long as the 
first and second moments if the service time can be written in the form: 


E[X\ = P, (15a) 

r 

E\X 2 ) = (15b) 

where r is the service rate and (3 and // are positive numbers. A wide class of distributions have 
such characteristics. For example, (3 = 1 and rj = 2 correspond to exponential service time; 
(3 = 1 and // = 1 correspond to constant service time. In general, the queues in the system are 
not M/M/1 queues. In contrast to (7) and (8), the formulas for calculating the average packet 
delay of UE group j become: 


£(1) = (& ~ P 2 ) X T + /frj 1} 
rf ] (rf-pxfY 

, (2) _ (h ~ P 2 ) X T + Prf + \vj\f 

^ rf (r?-flX?) + 

Then the objective function in PI is rewritten as: 



(16a) 


(16b) 


U 




(17) 


jeK. 

Proposition 2: The new objective function (17) is bi-convex in A and r. 

Proposition 2 is proved in Appendix D. Due to Proposition 2, the techniques proposed in 
Section III and Section IV still apply to the problem of user association and spectrum allocation 
with general packet length distribution . 





17 



Fig. 3. The topology of the 5-AP network. 

TABLE I 

Parameter Values. 


Parameters 

Value/Function 

AP transmit power 

23 dBm 

Total bandwidth on each RAT 

10 MHz 

Average packet length 

0.5 Mbits 

AP to UE pathloss 

140.7 + 36.7 log 10 (R) 


VI. Numerical Results 

Simulations are carried out using the network topology depicted in Fig. [3} The HetNet is 
deployed over a 100 x 200 m 2 area. Five APs, denoted by triangles, and 15 UE groups, denoted 
by the squares, are randomly dropped in the area. The spectral efficiency is calculated using (3) 
assuming a - 1: = 1 and = 1/2 with a 30 dB cap on the receive SINR (SINR greater than 30 
dB is regarded as 30 dB). Other parameters used in the simulation are given in Table I, and are 
compliant with the LTE standard [32]. The results for actual packet delay with the utilization 
service rate model are obtained through a packet-level simulator, which adapts the transmission 
time of each packet to the instantaneous active interfering APs. 


5 Note that the pathloss models for different RATs need not be the same. 
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(a) Spectrum allocation pattern for LTE 
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(b) Spectrum allocation pattern for LTE-U 

Fig. 4. Spectrum allocation patterns under heavy traffic, uh = 1, vm = 0.01, vl = 0.0025. 


A. The Consen’ative Allocation Scheme 

The conservative spectrum allocation and UE-AP association according to the solution of 
PI under different traffic loads are shown in Figs. 4 and 5. Each smaller rectangle indicates 
the spectrum allocation at the corresponding UE group. The different colors represent different 
patterns. The amount of spectrum resources allocated to each user group under each pattern 
is denoted by the size of the corresponding bar inside the rectangle. The normalized average 
packet arrival rate relative to the total (sum) average arrival rate of each user group as well as 
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x (meters) 


(a) Spectrum allocation pattern for LTE 



(b) Spectrum allocation pattern for LTE-U 

Fig. 5. Spectrum allocation patterns under light/medium traffic, vh = 1, i 'm = 0.01, vl = 0.0025. 


the intensity of interference nearby from the unlicensed band are shown above the rectangle. 
For example, for the UE group on the top left, 19/28 of its traffic load is assigned to be served 
using LTE while the remaining 9/28 is to be served using LTE-U. There are three interference 
levels, referred to as “High”, “Medium” and “Low”, according to the intensity of the interference 
nearby from the unlicensed band. For concreteness, we let the corresponding second moments 
of the vacation duration in (8) be uh = 1, vm = 0.01, ul = 0.0025. When the second moment 
vl = 0.0025, the average vacation time is similar to the average packet service time, which is 
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about 0.05 seconds/packet. Each line segment joining an AP and a user group describes their 
association. The color bars on the right of each figure shows the actual spectrum partition into 
different patterns. Theorem 1 and Theorem 2 can be verified by counting the number of pieces 
in the partition and the number of rectangles connecting multiple triangles, respectively. For 
instance, in Fig. 4, the licensed band is partitioned into 7 segments and the unlicensed band 
is partitioned into 6 segments, both numbers of partitions are smaller than the number of UE 
groups. Moreover, there is only one UE group served by multiple APs in the unlicensed band. 

Fig. 4 shows the spectrum allocation patterns for the licensed band and unlicensed band in 
a high traffic scenario. The licensed band is partitioned into 7 segments and the unlicensed 
band is partitioned into 6 segments. As we can see, the spectrum resources allocated to each 
user group is roughly proportional to the corresponding traffic demand. Since the licensed band 
alone cannot support all the UE groups, some UE groups with low traffic demand are served 
by using the unlicensed band only and most licensed spectrum is allocated to the UE groups 
with high traffic. In addition, even though some UE groups have high traffic demand (e.g., the 
top right one), more unlicensed spectrum is allocated to them because they do not have much 
nearby interference from other RATs in the unlicensed band. In contrast, some UE groups with 
low traffic demand (e.g., the one in the middle with arrival rate 2 packets/second) may also be 
allocated licensed spectrum if the nearby interference from the unlicensed band is severe. 

Fig. 5 shows the spectrum allocation patterns for the licensed and unlicensed bands in a 
medium/low traffic scenario. The licensed band is partitioned into 6 segments and the unlicensed 
band is partitioned into 4 segments. Since the licensed band alone is almost enough to support all 
the UE groups, most of them are served by the licensed band, and only a few of the UE groups 
are served by the unlicensed band because of the low traffic demand and lower interference 
generated within that band. In addition, most spectrum is allocated to the UE groups with high 
traffic. 

B. The Utilization-Dependent Allocation Scheme 

Clearly, the delay obtained by using the conservative allocation is an upper bound on the actual 
delay obtained based on the utilization-dependent model. To validate the utilization-dependent 
model, a packet-level simulator is used to compare the theoretical delay with the actual delay. 
Fig. 6 compares theoretical and actual delays and service times using the utilization-dependent 
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Fig. 6. Analytic and simulated delay for the utilization model. 


model. The service transmission time of a packet is part of the packet sojourn time excluding the 
queueing delay. The horizontal axis is the average traffic load of each UE group. All curves in 
Fig. 6 are based on the same spectrum allocation. The utilization approximation is quite accurate 
with light traffic. When traffic loads are heavy, the approximation becomes coarser due to more 
interactions among APs. In addition, compared with delay, the service time increases much 
more slowly with traffic load, indicating that the spectrum is efficiently allocated to mitigate 
interference among APs. 

Fig. 7 compares the optimization objective, average packet sojourn time, for the conservative 
and the utilization-dependent allocation schemes with orthogonal and full-reuse allocations. As 
the traffic increases to 40 and 50 packets/s, respectively, full-reuse and orthogonal allocations 
fail to support all the UE groups, suggesting these are the maximum throughputs under these 
two allocation schemes, respectively. Hence, the proposed conservative and utilization-dependent 
allocation schemes achieve a significantly larger throughput region than the other schemes. In 
addition, both conservative and the utilization-dependent allocation schemes yield significant 








22 



Fig. 7. Comparison of the proposed schemes with benchmark schemes. 


gain especially in the high traffic scenario. The reason is that the proposed spectrum allocation 
schemes are traffic-aware, i.e., in the low traffic regime, it is better to reuse most of the spectrum, 
while in the high traffic regime, it is better to adaptively allocate the spectrum across APs. 
Furthermore, the proposed schemes exploit the particular characteristics of the RATs. That is, 
UE groups receiving less external interference from the unlicensed band are more likely to be 
allocated spectrum from that band. Furthermore, the actual delay based on the conservative 
allocation is also given, which is between the theoretical delay using conservative allocation and 
the actual delay using the utilization-dependent allocation scheme. The utilization-dependent al¬ 
location scheme always outperforms the conservative allocation scheme as it accurately accounts 
for dynamic inter-cell interference. In low traffic, the allocation based on the utilization-dependent 
model reduces the average delay by about 40% compared to the conservative allocation, and this 
improvement becomes smaller as traffic loads increase. 

Fig. 8 shows the optimal allocations for the licensed and unlicensed bands under different 
traffic loads using the conservative and utilization-dependent allocation schemes. Rectangles 
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Fig. 8. 
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represent frequency bands and solid ones are used by the corresponding APs. A stack of 
solid rectangles then represents a reuse pattern. The length of each rectangle is proportional 
to the fraction of the whole spectrum occupied by the corresponding pattern. In both Fig. 8a 
and Fig. 8b, when traffic loads are low, the allocation scheme using the utilization-dependent 
model tends to be full reuse, while as traffic loads increase, it tends to orthogonalize the 
spectrum. In comparison with the conservative allocation, which remains orthogonal under 
different traffic loads, the utilization-dependent allocation uses the spectrum more efficiently 
since it approximates interaction among APs more accurately. 

VII. Conclusion 

We have studied spectrum allocation in downlink HetNets with multiple RATs over different 
bands using the average packet sojourn time as the performance metric. In addition to the 
licensed band, a queueing model with vacation has been proposed to model the additional delay 
of the unlicensed band. Two optimization based schemes have been proposed and shown to be 
highly effective. A sparse allocation (in terms of both the number of spectrum segments and 
user association) achieves the optimal network utility. Simulation results show that the proposed 
allocation schemes yield user associations and spectrum allocations, which utilize the spectrum of 
each RAT more efficiently compared with the benchmark allocation schemes, namely, orthogonal 
frequency reuse and full-frequency-reuse. Ongoing work is to extend the optimization framework 
to give a resource allocation solution with complexity that scales with the size of the network. 


Appendix A 

Proof of Proposition 1 

To analyze the queueing model with vacation and nonexhaustive service, we follow a similar 


technique as in [311. Denote the residual service time at time t by R(t), and the waiting and 


service times for the i -th packet as W t and X respectively. We have, 

E\X] = 

r 

Assuming the queue is stable, by the Pollaczek-Khinchine formula, 

E[R] 


(17) 


E[W] = 


1 ~P 


(18) 
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Fig. 9. Residual service time R(t). 


and the average packet delay is given by: 

E[T] = E[W ] + E[X\ = ^ (19) 

where p = K Denote M{t) as the number of packets served up until time t. To calculate E[R\, 
we can see from Fig. 9, 


1 

E[R] = lim - / R(r)dr 
t^-oo t J 0 

(20) 

= li + 

2 2 J 

(21) 

M(t) ™ (Xp + (Vp 
t^oo 2 t M(t) 

(22) 

= \ (B[A' 2 ] + E[V 2 ]) 

(23) 

A \v 

(24) 

~ r* + ~2~' 


The equalities hold in the almost sure sense. Substituting (24) into (19), we obtain (7). 
To prove the convexity of (7), note that (7) can be written as the addition of two parts, 

1 v rX 


t = 


v 

(r — A) + + 2( r -A) + ' 

Since both parts are convex in the pair (r, A) on R 2 , the sum is also convex in the pair (r, A) 
on R 2 . ■ 


(25) 
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Appendix B 
Proof of Theorem 1 


We first reformulate PI by a change of variables. The proof then follows a similar geometric 
argument as in [17]. 

Consider a reformulation of PI by replacing constraints (Pic), (Pie), and (Pig) with the 
following three constraints, introducing a new collection of variables 


Jl). 

3 

= E (E 

M A,l \ A,l 

I y 

, j'G/C,Zg{ 1,2} 


AcAf \i£Af 

/ 



E 

z A ' 1 < 1 

l G 

{1,2},* 

G Af, Ac Af 

jeK 





~A,l 

“i—tj 

,^>0, 

j e 1C, l g 

{1,2},* 

eAf.AcAf. 


(P4a) 

(P4b) 

(P4c) 


The new problem, referred to as P4, is equivalent to PI. This is because the feasible set for 
the rate tuple r remains the same, which is easy to see by regarding z AA J as the fraction of 
spectrum under pattern A that AP i allocates to UE group j over RAT /. If one solves P4, the 
actual spectrum allocations can be recovered as = y A,l z£jj. 

We show that if r* is an optimal rate tuple of PI, then we can attain each sub-tuple r* u> 
over RAT l with a /.'-sparse y u '. For each RAT l, let us begin with a generally nonsparse 
optimal solution y^ l \ whose support is S ® ( y A,l = 0 if A ^ S ^). Let us freeze the optimal 
z^j variables and define a /'-vector q AJ for every A G S® with its elements determined by 
A, 1 _ ^2 According to (P4a), a convex combination of the vectors ( q A ' 1 )az 


tesw 


with (y A ’ l )A<zs w a s coefficients form the optimal rate tuple r U] over RAT l. By Caratheodory’s 
Theorem [33], can be represented as a convex combination of at most k + 1 of those 
vectors. Moreover, r ll} must be on the boundary, not in the interior of the convex hull of (q AJ ), 
because otherwise the rate tuple can be increased in all dimensions, contradicting the optimality 
assumption. Thus, for each RAT l, we can identify a vector y AI> whose support is a subset of 
1 5^ with k or fewer elements, such that the optimal is a convex combination of (q AA ) with 
y* A ’ 1 as coefficients. ■ 
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UE groups 


BTS's 



Fig. 10. A loop in the BGR for the UE groups served by multiple APs over the same RAT. 


Appendix C 
Proof of Theorem 2 

The proof follows an analogous proof in [|5]. The KKT conditions for PI for nonzero elements 
of x and y are : 


dU i jyi 

sit - v? = o, 


dr-j - ) 

XX’* = £ (0 , 

icAT 


(26a) 

(26b) 


where )i % 1 and are the Lagrange multipliers for constraints (Pie) and (Plf), respectively. 

Assuming UE group j is served by two APs i L and i 2 over RAT l, define sf\. • = ^ and 

Ac Af 

nf 1 = vt' 1 - According to (26), we have 

AcAT 


S {1) ■ 

**2 


(0 

<_ 

(0 ■ 

/4 


(27) 


Following the argument in [|5], a bipartite graph representation is used as in [341]. For each RAT, 
denote the UE groups served by multiple APs and the corresponding APs as nodes. An edge 
between a UE group and an AP represents an association. It remains to show that the graph 
contains no loop. Suppose there is a loop in the bipartite graph as shown in Fig. 10. Then there 
exists a sequence of nodes of users j \,..., j p and a sequence of APs ..., i p , where user j q is 
connected with AP i q for q — 1,... ,p, user j q+1 is connected with AP i q for q — 1,... ,p — 1, 
and user 1 is connected with AP p. The nodes are distinct otherwise we can find a smaller loop 


with this property. According to (27), the loop implies: 
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JO JO 

*1-5-71 *2-U2 
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Since sf\j is the sum of spectral efficiencies over all patterns over RAT l, it is a random variable 

a (0 . s (0 . sf >_ ^ . 

based on random topology. Therefore, \ P ^ J1 ) ] , ~ r2 ... lp (l) 1 ^ Jp = 1 is a zero probability event, 

Si 2^J2 S ip^>jp 

which shows that w.p.l there is no loop in the graph. Since there are n APs, the largest possible 
BGR without a loop has n — 1 user nodes, which proves Theorem 2. ■ 


Appendix D 

Proof of Proposition 2 

Taking the second derivatives of Xpt ^ with respect to and r^\ we have: 




rjr 


(i) 


(i)" 


d\ 




,(i) 


rj X 


(i) 


A 11 ) 3 ’ 
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dr 


(W 


P 


(r- x) - /3XY’) 3 


dh 


,(i) 
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2/5A 
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J 1 ) 
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3 ' 


(28a) 


(28b) 


When -Tjy > -nr, in other words, when the queue is stable, the derivatives are positive, which 


A 


j j 

means is bi-convex in A^ and rj 1) . In addition, since Ais similar to X^t^ except 

( 2 h „( 2 ) / 2 ■) ( 2 ) (2) / '(2) 

m - m —, which is also bi-convex in A; and r) , A; t) is also 

2 {r) —p\] ; )+ J J J 3 


3 3 

for an additional term 




3 r 3 

bi-convex in A^ 2) and r 'p. Since U is a linear combination of bi-convex functions, we conclude 
that (17) is bi-convex in A and r. ■ 
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